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Abstract 


Several  notions  of  stochastic  convexity  and  concavity  and  their 
properties  are  studied  in  this  paper.  Efficient  sample  path  approaches  are 
developed  in  order  to  verify  the  occurrence  of  these  notions  in  various 
applications.  Numerous  examples  are  given.  The  use  of  these  notions  in 
several  areas  of  probability  and  statistics  is  demonstrated.  In  queueing 
theory,  the  convexity  [as  a  function  of  c]}  of  the  steady  state  mean  waiting 
time  in  a  GI/D/c  queue,  and  [as  a  function  of  the  arrival  and  service  rates] 
in  a  GI/G/1  queue,  is  established.  Also  the  convexity  of  the  queue  length  in 
the  M/M/c  case  [as  a  function  of  the  arrival  rate]  is  shown,  thus 
strengthening  previous  results  while  simplifying  their  derivation.  In 
reliability  theory,  the  convexity  of  the  payoff  in  the  success  rate  of  an 
imperfect  repair  is  obtained  and  used  to  find  an  optimal  repair  probability. 
Also  the  convexity  of  the  damage  as  a  function  of  time  in  a  cumulative  damage 
shock  model  is  shown.  In  branching  processes,  the  convexity  of  the  population 
size  as  a  function  of  a  parameter  of  the  offspring  distribution  is  proved.  In 
nonparametri c  statistics,  tne  stochastic  concavity  [convexity]  of  the 
empirical  distribution  function  is  established.  And,  for  applications  in  the 
theory  of  probability  ineqalities,  we  identify  several  families  of 
distributions  which  are  convexly  parametrized. 

AMS  Subject  Classification:  Primary:  60E05,  Secodary:  b2E10,60K25,60Kl0. 

Key  words  and  phrases:  Stochastic  monotonicity,  classes  of  distribution  with 
the  semigroup  property,  Poisson  process,  queues,  proportional  hazard, 
imperfect  repair,  branching  processes,  empirical  distributions,  convex 
parametri zation ,  majorization  and  Schur-convexi ty ,  reliability  theory, 
cumulative  damage  shock  models.  X'7,.  7\ 


1.  Introduction. 


i-lany  collections  of  random  variables  {X(e),GeG}  [e.g.,  some  stochastic 
processes]  have  the  "property"  that  in  some  sense  X(9)  is  stochastically 
convex  (or  concave)  and  perhaps  also  increasing  (or  decreasing)  in  o.  In 
this  paper  we  discuss  some  notions  of  stochastic  convexity  (concavity)  and 
develop  efficient  sample  path  approaches  to  verify  the  occurrence  of  these 
notions  in  various  stochastic  processes. 

Section  2  consists  of  some  preliminaries  and  definitions.  Stochastic 
inonotoni ci ty  and  some  notions  of  stochastic  convexity  are  discussed  there. 
3asic  properties  of  these  notions  are  also  given  in  the  same  section.  Sample 
path  convexity  and  concavity  notions  are  defined  and  studied  in  detail  in 
Section  3.  These  notions  have  the  advantage  that  they  are  sometimes  easy  to 
verify  and  that  they  yield  the  useful  convexity  and  concavity  concents  of 
Section  2.  3asic  preservation  results,  which  are  useful  in  tne  applications 
to  follow,  are  also  given  in  Section  3.  A  sample  of  collections  of  random 

variables  {X(o),jeG}  which  satisfy  the  notion  of  sample  path  convexity  or 

concavity  is  given  in  Section  4.  These  collections  (X(6),0t:j}  are  either 
parametric  families  of  random  variables  or  well  studied  stochastic 
processes.  Combination  of  the  examples  in  Section  4  with  the  properties 
obtained  in  Section  3,  and  with  the  fact  that  sample  path  convexity 
(concavity)  implies  the  convexity  (concavity)  notions  of  Section  2,  yields  a 
host  of  applications  in  various  areas  of  probability  and  statistics.  A  sample 
of  such  applications  (in  queueing  theory,  reliability  theory,  branching 
processes,  nonparametri c  statistics,  and  in  the  theory  of  probability 

inequalities)  is  given  in  Section  5.  In  particular  it  is  snown  how  various 

monotonicity  and  convexity  (concavity)  results,  which  have  been  obtained  in 
the  literature  using  tedious  algebra,  can  be  easily  obtained  (and 


strengthened)  using  the  sample  path  convexity  (concavity)  approach. 

Throughout  this  paper  'increasing*  [ 'decreasing* ]  means  'nondecreasing' 
['nonincreasing'].  Whenever  an  integral  /^(x)dF(x)  [or  expected  value 
E 9 ( X ) ]  is  written,  it  is  tacitly  assumed  that  .?  is  such  that  the  integral 
[or  E 9( X ) D  exists.  Also,  it  is  tacitly  assumed  that  all  the  real  functions 
mentioned  in  this  paper  are  Borel  measurable. 

2.  Prel iminaries;  stochastic  and  convex  orderings. 

A  class  C  of  functions  R  -*•  R  can  generate  u  partial  ordering  on 
the  set  of  distribution  functions  on  R  t  (-»,«)  py  postulating  that  any  two 
such  distribution  functions  F  and  G  satisfy  F G  if  and  only  if 

CO  oo 

(2.1)  /  .?(x)dF(x)  j  -(x)dG(x)  for  all  C. 

-oo  -u> 

The  following  definitions  can  be  found,  e.g.,  in  Stoyan  (lhR3). 

Definition  2.1 .  Let  X  and  Y  be  random  variables  with  distribution 
functions  F  and  G  respectively. 

(a)  Denote  X  Y  and  say  X  [or  F]  is  stochastically  less  than  Y  [or  G] 
if  (2.1)  holds  for  the  class  C  of  real  increasing  functions  on  the  union 
of  the  supports  of  F  and  G. 

(b)  Denote  X  <cx  Y  [respectively,  X  Y]  if  (2.1)  holds  tor  tne  class 

C  of  real  convex  [respectively,  concave]  functions  on  the  convex  all  of 
the  union  of  the  supports  of  F  and  G. 

(c)  Denote  X  Y  [respectively,  X  <-cv  Y]  if  (2.1)  nolds  for  the  class 
C  of  real  increasing  convex  [respectively,  concave]  functions  on  the 
convex  hull  of  tne  union  of  the  supports  of  F  and  G. 


(d)  Denote  X  s- „  Y  if  (2.1)  holds  fo°  the  class  C  of  real  increasing  linear 
functions  on  the  convex  null  of  the  union  of  the  supports  of  F  and  G. 
For  a  distribution  function  H,  let  H  denote  1  -  H.  The  following 
results  are  well  known  (see,  e.g.,  Stoyan  (1983)). 


Theorem  2.2.  Let  X  and  Y  be  random  variables  with  distribution 
functions  F  and  G  respectively.  Then 


(a) 

X 

St  Y  <=> 

for 

all  x  c  R 

(b) 

X 

CO  oc 

<icx  Y  <=>  -  ^^)dy  '  ,  o(y)dy 

X  X 

for 

all  x  c  r 

(c) 

X 

X  X 

^icv  Y  <=>  /  F(y)dy  •;  /  G(y)dy 

for 

all  x  r.  R 

(d)  X  <. ,  Y  <=>  EX  <  EY. 

The  relation  s  is  sometimes  cal  led  dilation.  Conditions  wnicn  are 
equivalent  to  X  •;  Y  can  be  found,  e.g.,  in  Shaked  (1980). 

Remark  2.3.  Some  useful  properties  of  tne  ' i cx '  and 
(here  X  and  Y  are  nonnegative  random  variables): 

(i)  X  Vx  V  =  >  £Xk  <  £Yk, 

(it)  X  <jcv  V  =>  EXl/:<  s  EYI/K, 

Let  1  =*■ '  denote  equality  in  law. 

Theorem  2.4.  If  X  c  Y  then  tne  re  exist  X  and  i  oefi'vd  :n  tne  g  ime 

-  s  t 

^  -  f  *  ■> 

probability  space  such  that  X  =“  X,  Y  Y  inn  <  ■  <  a.-,. 

For  every  distribution  il  denote  i  1  'a)  -  inf '  •<;.!(:<.:  u  ;•  ,  u  :  f  ),  1 

■^.iiarx  2.1.  In  Theorem  2.4  one  may  set  '  -  r  \  n,  ■  --  T-i(  :)  where  u 


'  i  c  v '  conditions  are 


is  a  uniform  (0,1)  random  variable. 


Let  {Pa,6eQ}  be  a  family  of  univariate  distributions.  Throughout  this 
paper  o  is  a  convex  set  (that  is,  an  interval)  of  the  real  line  or  of  the 

set  {0,1,2,...}.  Let  X ( 5 )  denote  a  random  variable  with  distribution  P  . 

lie  find  it  convenient  and  intuitive  to  replace  the  notation  {P^.QeO}  by 

{X( 0) , QeO}  and  this  notation  will  be  used  throughout  this  paper.  Note  that 

when  we  write  {X(0),OeG}  we  do  not  assume  [and  often  we  are  not  concerned 
with]  any  dependence  (or  independence)  properties  among  the  X(<3)'s.  We  are 
only  interested  in  the  'marginal  distributions'  {P,«,aeO}  of  {X(u),0eC}  even 
when  in  some  circumstances  {X(G),OeO}  is  a  well  defined  stochastic  process. 
Note  also  that  X(6)  does  not  mean  that  X  is  a  function  of  0;  it  only 
indicates  that  the  distribution  of  X(3)  is  PQ.  Thus,  for  example,  for 
9:R-*R,  the  notation  E$(X(0))  stands  for  /^dP^  ---  this  is  usually  denoted 
in  the  literature  by  E  ?(X).  When  {X(0),OeO}  is  a  well  defined  stochastic 
process  then  the  notation  E$(X(e))  is  often  justifiably  used. 

In  the  following  definition  the  abbreviations  SI,  SCX,  SCV,  SICX,  SIL, 
SD,  SDCV  etc.  stand,  respectively,  for  stochastically  increasing, 
stochastically  convex,  stochastically  concave,  stochastically  increasing  and 
convex,  stochastically  increasing  and  linear,  stochastically  decreasing, 
stochastically  decreasing  and  concave  etc. 

definition  2.6.  Let  {X(u),OeO}  be  a  set  of  random  variables,  denote 
(a)  {X( 0) , 0eG}  e  SI  [SO]  if 

(2.2)  -?eC  =>  v(‘)  =  MX(-))  ,  C 

for  C  -  the  class  of  all  increasing  real  functions  on  R ,  ind  C,  - 


the  class  of  all  increasing  [decreasing]  real  functions  on  c. 

(b)  {X(  ti) ,  beO}  e  SCX  [SCV]  if  (2.2)  holds  for  C  -  the  class  of  all  real 
convex  [concave]  functions  on  R,  and  CQ  -  the  class  of  all  real 
convex  [concave]  functions  on  c. 

(c)  {X(0),6eG}  e  SICX  [SI CV,  SIL]  if  {X(p),t3eC}  e  SI  and  if  (2.2)  holds 

for  C  -  the  class  of  all  increasing  and  convex  [concave,  linear]  real 
functions  on  R,  and  C..  -  the  class  of  all  increasing  and  convex 

[concave,  linear]  real  functions  on  o. 

(d)  {X(3),3eO}  e  SOCX  [SDCV,  SDL]  if  (X( 9),3eO}eS0  and  if  (2.2)  holds 
for  C  -  the  class  of  all  i ncreasi ng  and  convex  [concave,  linear]  real 
functions  on  R ,  and  C„  -  the  class  of  all  decreasing  and  convex 
[concave,  linear]  real  functions  as  o. 

Some  basic  properties  of  these  notions  are  given  next. 

Lemma  2.7.  If  ;/(  v ) , tSI  [respectively,  SD]  then  there  exist  random 

variables  x(v),  u.c,  oerined  on  a  common  probability  space,  sucn  that 
X ( u )  =  X(j),  u  .,  and,  a.s.,  X(u)  is  increasing  [respectively, 

decreasing]  in 

One  way  to  construct  {X( -a) ,  utci  in  Lemma  2.7  is  to  set 
X ( u )  =  F"  (U,u)  u  e  C,  Where  U  is  a  uniform  (0,1)  random  variable  and 
F-1(u,u)  =  inf  jx:P(X(  0 ) > x  >  •;  a  } . 

Remark  2.8.  It  is  worthwhile  to  note  down  the  following  'continuous'  inaloj 

of  Remark  2.3. 

(i)  { X  (  0 ) ,  o  e  0}  e  SICX  *>  EXf'(-;)  is  increasing  and  convex  in  -  • 

for  k  =  1,2,  ...  . 

Hi)  {X(  0) ,  ;  e  0}  t  S I  CV  =>  EX1 ' k(  j)  is  increasing  and  concave  in  .  •  c 


for  k  =  1,2,  ...  . 

(iii)  In  particular,  if  {X ( 0) ,  0  e  0}  e  SICX  [SICV]  then  EX ( 0)  is 
increasing  and  convex  [concave]  in  a  e  c. 

Remark  2.9.  In  Definition  2.6  (a),  (b)  and  (c)  we  require  C  and  C  to  be 

0 

"similar"  classes  (e.g.,  for  SICX,  both  are  the  classes  of  increasing  convex 
functions).  In  general  these  need  not  be  "similar".  For  example,  of  a 
particular  interest  is  the  class  of  processes  {X(o),3eo}  such  that  E$(X(o)) 
is  increasing  and  convex  in  >3  for  all  increasing  functions  g>.  Such  classes 
will  be  considered  elsewhere  (but  see  Proposition  5.7). 

Some  of  the  stochastic  notions  of  Definition  2.6  are  often  preserved 
under  reparametri zati on  (or  time  transformation) : 

Proposition  2.10.  (a)  If  {X(g),6eo}  c  SI  [SD]  and  h:oc  is  increasing 

then  {X ( h ( 0) ) ,  6  e  0}  e  SI  [SD]. 

(b)  If  {X(0),9eG}  e  SICX  [SICV,  SIL]  and  h:o  +  0  is  increasing  and  convex 
[concave,  linear]  then  {X(h( 0) ) ,  QeO}  e  SICX  [SICV,  SIL]. 

(c)  If  {X ( 0) , OeO}  e  SDCX  [SDCV,  SDL]  and  h:0  +  G  is  i ncreasi ng  and 
concave  [convex,  linear]  then  {X(h(g)),  3eG}  £  SDCX  [SDCV,  SDL]. 

The  proof  of  Proposition  2.10  is  straightforward.  So  is  also  the  proof 
of  the  next  result.  Let  '5^'  denote  convergence  in  law. 


Proposition  2.11.  Suppose  (X._(j),  3  c  0}  £  C  for  m  =  1,2,  ...  .  If 
■  —  n 

X  ( 0 )  *X(  u)  for  each  9  u  then  {X(j),v;:j}  £  C  where  C  ,.{SI,  SD,  SCX, 
SCV,  SICX,  SDCX,  SICV,  SDCV,  SIL,  SDL}. 
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! .  Sample  path  convexity:  definition  and  some  properties. 

The  interest  in  this  paper  centers  around  the  monotone  convex  and  concave 
notions  SICX,  SICV,  SDCX  and  SDCV.  In  this  section  we  find  sufficient 
conditions  which  imply  that  a  process  {X( 3) , OeO}  satisfies  some  of  these 
notions.  Our  approach  is  to  ‘put1  some  (more  explicitly  four)  of  the  random 
variables  {X(p),QeO}  on  a  common  probability  space  and  then  obtain  ‘almost 
sure1  results  which  carry  back  to  the  whole  process  {X(o),ueO}. 

We  start  with  a  definition  wnich  formally  states  these  conditions.  For 
any  four  real  numbers  x^,  x?,  X3,  xi  we  abbreviate  the  conditions 


Xj  <  ininlx^x^)  ^  max(x^,x^)  <;  x^  by  [x^,x0]  ^  x^.  Also, 

x1  [x0,x,,  ,x ,,]  denotes  x,  x  mi  nf  x?  ,x^  )  and  [xl5x9,x^]  <  ) 


'1  L2’3’4 

max(x^ ,x^,x3)  <  x^. 


'1  ,A2’  3- 


denotes 


Jefinition  3.1.  (a)  The  family  {X(  j)  ,  :•  <:  '}  is  said  to  be  stochastically 

increasing  and  convex  in  sample  path  sense  if  for  any  p,  i  = 

1 ,2,3,4,  such  that  and  j,  +  ■,  -  r  there 

I  0  0  4  l  4  .3 

exist  four  random  variables  X.,  i  =  1,2, 3, 4,  defined  on  the  same 
probability  space  sucn  that 


(st) 

^  =  X(  u.  ) , 

i  =  1, 2, 3, 4, 

(cx) 

h  *  b  -  h 

+■  X.  a.s.  (convexity  condition). 

(i-cx) 

CXi »x2 »x33  < 

X1  a.s.  (monot  onicitv  -condition!. 

denote  conditions  (st),  (cx),  (i-cx)  by  {*(•,•), 
(b)  If  (st)  holds  and  also  (cv)  and  (i-cv),  wher*' 

(cv)  XT  v  X,  •  X,  -  ?3 


(i-cv)  3.S., 

then  denote  (X(e),  o  e  e}  e  SICV(sp). 

(c)  If  (st)  and  (z)  hold  and  also  (i-cx)  [which  is  then  equivalent  to 
(i-cv)],  where 

U)  Xj  +  X4  =  X2  +  X3  a.s., 

then  denote  {X(o),  0  e  C}  e  SIL(sp). 

(d)  If  (st),  (cx)  and  (d-cx)  hold,  where 

(d-cx)  [X2,X3,X4]  <  Xj  a.s., 

then  denote  (X(v),  0  e  0}  e  SDCX(sp). 

(e)  If  (st),  (cv)  and  (d-cv)  hold,  where 

(d-cv)  X,  s  [X  x  ,X?,X3]  a.s., 

then  denote  { X  (  0 ) ,  •)  c  C)  e  SDCV(sp). 

(f)  If  (st)  and  (z)  hold  and  also  (d-cx)  [which  is  then  equivalent  to 
(d-cv)]  then  denote  { X  (  3 ) ,  ■>  c  G}  e  SUL(sp). 

In  order  to  gain  some  insight  into  the  monotonicity  and  the  convexity 
conditions  aoove  consider,  for  example,  the  SICX(sp)  case.  First  note  that 
(i-cx)  indeed  implies  stochastic  monotoni  ci  ty  of  {X(  o) ,  -j  c  0}:  from  (i-cx)  w 
nave  X  (  )  =t  *.  X^  X(v,)  and  tnus  {X(-j),  u  G}  e  SI  [see  definition 

2.6(a)].  Since  ^  s  ->  s  it  seems  lore  natural  to  postulate  tne 
stochastic  monoton i c i ty  hy  replacing  (i-cx)  hy  something  "simpler"  such  3S 


(i) 


a.s 


9 


:<i  <  x2  <  x3  <  x4, 


or 


( i ' )  \  <  [X2,X3]  s  X4,  a.s.. 

However  in  some  applications  we  found  it  hard  [if  not  impossible]  to  verify 
(i)  or  even  (i‘)  [see,  e.y.,  Subsection  5.3],  whereas  (i-cx)  could  be 
obtained.  Note  also  that  if  is  increasing  and  convex  [concave]  tnen  the 
set  {y(o),  -j  c  ■;>}  of  degenerate  random  variables  is  SICX(sp)  [SICV(sp)]. 

The  (sp)  conditions  enjoy  some  useful  preservation  properties  wnich  are 
discussed  below.  The  first  one  is 

Proposition  3.3.  (a)  If  {X(0),  0}  c  SICX(sp)  [SICV(sp),  3lL(sp!] 

and  if  p  is  an  increasing  and  convex  [concave,  linear]  function  tnen 
•:  p ( X (•;)),  ieG}  c  SICX(sp)  [SICV(sp),  SIL(sp)]. 

(d)  If  -;x(u),  ■;  £  0}  e  SOCX(sp)  [sncv(sp),  STl(  sp!  ]  and  if  .  is 
i ncreasi ng  and  convex  [concave,  linear]  function  then 
{ g>(  X(  □) ) ,  veG}  c  SDCX(sp)  [SOCV(so),  SOL'sp)]. 

Proof .  Suppose  { X ( 9 ) ,  0  c  c}  c  SICX(sp).  Let  ,  i  =  1,2, 3, 4,  be  such 
that  ^  -J4  and  +  -j4  =  .-9  +  n-  Let  X,  ,  i  =  1,2, 3, 4,  be 

random  variables  on  a  common  probability  space  such  that  (stl,  (ex)  and 

A  a  A  A 

(i-cx)  of  Definition  3.1  hold.  In  particular,  a.s.,  7  X,  «•  <.  -  mo 

j  L  -*■  C 

A  A 

n  X^.  Now,  the  convexity  arid  monotonicity  of  r.  imply 
■Mz)  -  r(XL)  <  o(X4)  -  )  .  .(X4)  -  ..  ( X  y ) .  M  so,  tne  monotomcity 

of  j  implies  [yU^),  V(X9),  y(X3)]  :{X})  a.s..  Thus  ;:<()),,  j  .  i 

satisfies  (st),  (cx)  and  (i-cx)  of  Definition  3.1.  The  proofs  of  the  oICV  and 


SIL  cases  and  of  (b)  are  similar,  u 

The  next  result  is  a  dual  of  Proposition  3.2.  It  shows  that  the  (sp) 

conditions  are  sometimes  preserved  under  reparametri zati on  (time 

transformation) .  First  the  following  lemma  is  proved.  Roughly  speaking  it 

says  that  if  ,  i  =  1,2, 3, 4,  exist  such  that  (st),  (cx)  and  (i-cx)  hold 

whenever  { 0^ ,  i e{l ,2,3,4,}}  e  SIL(sp)  then  such  X. ,  i  =  l ,2,3,4,  exist 

whenever  { 0 . ,  i  e  {1,2, 3, 4}}  e  SICX(sp).  Let  °cx  s  <(ei.O2.O3.04): 

<  02  <  63  <  64  and  e2  +  °3  <  0i  +  94 }  and  let 
4 

Gcv  =  U  9^  >  82  »e3  »^4 ) :  °1  <  02  *  63  <  94  and  °2  +  °3  >  °1  +  S4^'  Be^ow  we 
assume  G  c  [0,«) . 

Lemma  3.3.  Suppose  that  for  each  3  c  0  the  distribution  of  X(e)  has  no 
atoms . 

(a)  If  { X ( 6 ) ,  0  e  0}  e  SICX(sp)  [SDCV(sp)]  then  for  each 

4  * 

(9^,0^, O3 , ©4 )  e  Ocx  there  exist  X. ,  i  =  1,2, 3, 4,  defined  on  a 
common  probability  space  which  satisfy  (st),  (cx)  and  (i-cx)  [(cv) 
and  (i-cv)]  of  definition  3.1. 

(b)  If  { X ( 0 ) ,  0  e  c}  e  SICV(sp)  [SDCX(sp)]  then  for  each  (e^  ,02 ,03  •  °4 ) 

4 

e  ocv  there  exists  X. ,  i  =  1,2, 3, 4,  as  in  (a)  which  satisfy  (st), 
(cv)  arid  (i-cv)  [(cx)  and  (d-cx)]  of  Definition  3.1. 

Proof.  First  we  prove  (a).  Suppose  { X  (  3 ) ,  ■;  e  0}  e  SICX(sp).  Let 
(  ®i ,  ^2 » ^3 »  ®4 )  e  Set  9^  —  max(0,  Jp+O^-u^)  and  -  mi  n(  3p+  3^  ,  •'4 )  • 

Then  u|  *  64  *•  ^4  and  +  °/J.  =  +  &3*  Then  there  exist 

XJ,  Xz,  X3.  X4  such  that  X}  X( 0! ),  i  =  1,4,  and 

^  X(  j-  ) ,  i  =  2,3,  and,  a.s.,  [Xj,x“2,X3]  c  X^  and  X^  +  Xj  >  X.,  +  Xr 

For  each  u  c  c  denote  F^(x)  3  P f X( 0 ) >x }  and 
F"^(u)  3  inf {x:F  (x)<u),  u  c  [0,1],  define 


Tnen  (using  the  fact  that  the  distributions  of  X,'  and  X'.  nave  no  atoms) 

x  4 

A  st  *  ct 

X^  =  X(o^),  X4  =  X(04)  and  (by  the  stochastic  monotonicity  of  X(ti)  in 

a  c  c)  )  X| ,  X4  >  V  Thus  X. ,  i  =  1,2, 3, 4,  satisfy  (cx)  and  (i-cx)  of 
Definition  3.1.  The  proof  for  SDCV(sp)  is  similar. 

The  proof  of  (b)  for  the  SICV(sp)  case  is  similar  to  tne  above  proof  of 
the  SICX(sp)  case.  The  main  difference  is  that  tnat  instead  of  'decreasing' 
and  O4  to  oj,  and  o4  and  tnen  'increasing'  :<j  anu 
X4  to  X^  and  X4 ,  in  the  SICV(sp)  case  one  first  'decreases'  ,-9  and  -j 
to  O'  and  o'  and  then  ‘increases'  X'  and  '<!,  to  x,,  and  %.  The  proof 
of  the  SDCX(sp)  is  similar,  ii 

KemarK  3.4.  The  assumption  of  no  atoms  in  Lemma  3.3  is  not  really 
necessary.  Even  without  this  assumption,  (a)  and  (b)  of  Lemma  3.3  odd.  The 
proof  of  tnis  statement  is  the  same  as  the  proof  of  Lemma  3.3  except  that 
constructions  (3.1)  and  (3.2)  are  to  be  modified  so  that  they  are  proper  for 
the  yeneral  case.  We  omit  the  lengthy  details. 


Proposition  3.5.  (a)  If  { X  ( a ) ,  -j  £  0}  e  SICX(sp)  [SDCV(sp)]  and  if 

9:0  +  0  is  increasing  and  convex  then  { X (  p (  j ) ) ,  ;  .  ■;  o I <3 < I  so) 

[SDCV(sp) ]. 

(d)  If  (X(b),  0  £  0}  £  SICV(sp)  [SDCX(sp)]  and  if  v:o  -  .  is  ’'icreasmj 
and  concave  tnen  (X(v(v)).  0  C}  c  SICV(sp)  [SUCX(sp)j. 

Proof .  We  only  prove  (a)  for  the  SICX(sp)  case.  The  proofs  of  tne  other 


statements  are  similar.  So  suppose  { X  (  :• ) , 


SICX(sp) .  Let 


Denote 


1 ,2,3,4,  be  such  that  0j_  <;  g2  <  63  <;  64  and  o  +  0^  =  +  0g. 

=  <?(G^),  i  =  1,2, 3, 4.  then  <  02  <  and  +  04  >  02  +  n^  * 

that  is  ( H| , n2 * , n4 )  e  o£x.  The  result  now  follows  from  Lemma  3.3  and 
Remark  3.4.  11 

The  next  result  shows  that  indeed  Definition  3.1  yives  sufficient 
conditions  for  stochastic  monotone  convexity  and  concavity  as  defined  in 
Definition  2.6. 

Theorem  3.6.  If  {X( 0) ,  0  e  C}  e  SICX(sp)  [SICV(sp),  SIL(sp),  SDCX(sp), 
SDCV(sp) ,  SDL(sp)]  then  {X( a) ,  GeO}  e  SICX  [SICV,  SIL,  SDCX,  SDCV,  SDL]. 
Proof .  Suppose  {X(e),  0  e  0}  e  SICX(sp).  Let  $  be  an  increasing  convex 
real  function.  Proposition  3.2(a)  shows  that  ($(X(e)),  GeO)eSICX(sp) .  That 
is,  if  6^,  i  =  1,2, 3, 4,  are  such  that  0^  <  <  63  <;  64  and 

A 

dl  +  04  =  °2  +  03  then  there  exist  four  random  variables  Y . ,  i  =  1,2, 3, 4, 
on  a  common  probability  space  such  that  Y-  9(X(G-)),  i  =  1,2, 3, 4,  and 

(3.3)  [y],  y"2,  Yj)  <  y4,  a.s.  . 

(3.4)  Yj  t  Y4  >  y‘2  *  v‘3,  a.s.  . 

The  stochastic  monotonicity  of  ($(X(g)),  GeO}  follows  from  (3.3).  From 

(3.4)  we  obtain  E$(X(q2))  +  E$(X(g^))  <  E^(X(e1))  +  E<j(X(g4))  wnicn  is 
equivalent  to  the  convexity  of  E$(X(o)).  Thus  (X(9),  GeO}  •;  SICX.  The 
proof  of  the  SICV,  SIL,  SDCX,  SDCV,  SDL  cases  is  similar. 

The  next  result  gives  sufficient  conditions  for  { X  (  j ) ,  .■  e  0}  to  oe  SCX 
and  SCV.  It  will  be  used  in  Subsection  5.7. 


Proposition  3.7.  If  { X  (  b ) ,  0  e  0}  e  SIL(sp)  or  SDL(sp)  then  { X  (  b )  ,  e  (;} 


SCX  and  SCV 


Proof.  We  will  show 

{X( 6 ) ,  G  e  0}  c  SIL(sp)  =>  { X ( 0 ) ,  3  c  0}  e  SCX. 

The  other  cases  can  be  shown  similarly. 

Suppose  { X ( o ) ,  0  c  0}  e  SIL(sp).  Let  y  be  a  convex  function.  Let 
G.j ,  i  =  1,2, 3, 4,  be  such  that  ^  ^  33  *  e4  dnd  +  °4  =  d2  +  °3 '  ^ 

we  show  that  E<?(X(j))  is  convex  in  o,  that  is, 

(3.5)  E v ( X (  iij))  +  Ep(X(G4))  >  £v(X(02)  +  E*(X(03)), 

then  it  follows  by  Definition  2.6(b)  that  (X ( e ) ,  a  c  G}  c  SCX. 

a 

To  show  (3.5)  let  X..  ,  i  =  1,2, 3, 4,  be  four  random  variable  on  a  common 
probability  space  such  that  X^  =t  X( 6^ ) ,  i  =  1,2, 3, 4,  and,  a.s., 

*  A  A  A  AAA  A 

X^  +  X>4  =  +  ^3  dncl  [XpX2»X3]  (or,  equivalently, 

Xj  s  [X^.X^jX^]).  The  convexity  of  3  implies  that,  a.s., 

(3.6)  ^(Xj)  +  >(X4)  >  o(X2)  +  ; ( X 3 )  . 

Taking  expectations  in  (3.6)  one  obtains  (3.5). 

The  following  lemma  gives  sufficient  conditions  for  sample  patn 
convexity,  concavity  and  linearity.  Usually  it  is  not  easy  to  verify  these 
conditions,  but  see  Example  4.5. 

Lemma  3.3.  Let  { X (  j ) ,  0  «■:  0}  be  a  collection  random  varibles  and  denote 
F_1(u;v)  =  inf  {x:P{X(  u)>x}  ■.  u},  u(.[0,l]. 


/.  .•  r  r 


lA  -V 


3  c  c.  If  for  all 


u  e  [0,1],  F~ 1 ( u ; 0)  is 

(i)  increasing  and  convex  [concave,  linear]  in  6  e  o  then  { X ( 0 ) ,  o  e  c}  e 

SICX(sp)  [SICV(sp),  SIL(sp) ]  . 

(ii)  decreasing  and  convex  [concave,  linear]  in  e  c  o  then  { X ( a ) ,  0  e  0} 

e  SDCX(sp)  [SDCV(sp) ,  SDL(sp)]. 

Proof.  For  the  SICX(sp)  let  0^ ,  i  =  1,2, 3, 4,  be  such  that 

<  ©2  <  ©3  <  64  and  0^  +  0^  =  62  +  0^ •  For  s ome  uniform  (0,1)  random 

variables  U  let  X^  =  F”*(U;0. ),  i  =  1,2, 3, 4.  It  is  easily  seen  that  X^  , 

i  =  1,2, 3, 4,  satisfy  (st),  (cx)  and  (i-cx)  of  Definition  3.1.  :i 

From  the  definition  of  sample  path  convexity,  concavity  and  linearity  it 
is  immediate  that  one  has: 

Theorem  3.9.  If  { X ( 6 ) ,  0  e  0}  and  (Y(a),  0  £  0}  belong  to  the  class  C 
where  C  £  (SICX(sp),  SICV(sp),  SIL(sp),  SDCX(sp),  SDCV(sp),  SDL(sp)}  and 
if 

Z( 0)  =  X( 0 )  with  probability  p, 

=  Y(e)  with  probability  1-p, 

then  {Z( 0) ,  6  e  0}e  C. 

Theorem  3.10.  If  { X ( 0 ) ,  0  e  0}  and  (Y(o),  0  e  0}  belong  to  the  class 
C  where  C  e  (SICX(sp),  SICV(sp),  SIL(sp),  SDCX(sp),  SDCV(sp),  SOL(sp)}  and 
if  X ( 0)  and  Y(o)  are  independent  for  each  0  e  n  then 
{X  (  0)  +  Y(  0) ,  OeO}  e  C  . 


4.  Exampl es . 


In  this  section  we  list  a  sample  of  examples  using  similar  constructive 
ideas  in  most  of  them.  Lemma  3.3  is  also  used.  Some  of  the  examples  are 
used  later  in  Section  5. 


Example  4.1  (classes  with  the  semigroup  property).  Let  { X ( 5 ) ,  oeO} 

[oc  (0,«)]  be  a  collection  of  random  varibles  with  the  semigroup  property  in 
6,  that  is,  if  Yj  and  Y9  are  independent  and 

Y1  “t  and  Y2  then  Y1  +  Y2  X(0,+O2).  I11  this  case 

{X ( u) ,  ueO}  c  SIL(sp)  . 

Proof .  Let  ui ,  i  =  1,2, 3, 4,  oe  such  that  ^  9-3  <  34  and 

(3 1  +  3^  =  02  +  9^.  Let  Y..  ,  i  =  1,2,3,  be  independent  random  variaDles  sucn 
that  Yj  =c  x(e1),  y2  X{  e2"  3i )  dnd  Y3  ^  x(e4-o2)  Ereca11 

34  -  o2  =  9 3  -  Oj].  Set  X,  =  Y\,  X2  =  Yj_  +  Y2,  X~3  =  Y ^  +  Y3  ana 
X4  =  Y^  +  Y2  +  Y9 .  It  is  easily  seen  that  X.,  i  =  1,2, 3, 4,  satisfy  (st), 
(i)  and  (i-cx)  of  Definition  3.1.  ;i 

It  follows  that  if  X( o)  is  a  Poisson  random  varible  with  mean  o  or 
gamma  random  variable  with  shape  parameter  0  or  negtive  binomial  random 
variable  with  the  proper  parametri zation  [or  binomial  random  variable  with 
0  being  the  number  of  independent  trials]  then 


{ X  (  0 ) ,  Se(0,*)}  [or  {X(  0) ,  Oe{l  ,2, . . . } }]  belongs  to  SIL(sp).  Mso,  if  Xj  , 

j  =  1,2,  ...,  are  independent  nonnegative  identically  distnouted  random 

n 

variables  and  $  e  U,  S  =  V  x.  then  ,  i  -c  {0,1,2,...;;  nave  the 

n  J=1  J  1 

semigroup  property  in  i.  Thus  {S^ ,  i  c  {U,l ,2, . . . }  }.3IL( s j) . 


Example  4.2.  (nonhomogeneous  Poisson  process).  Let  (X(t),  t  a  [),-)}  he  a 
nonhomogeneous  Poisson  process  with  intensity  function  If  \  is 


increasing  [decreasing,  constant]  then  {X(t),  t  e  (0,®)}  e  SICX(sp) 
[SICV(sp),  SIL(sp) ]. 

Proof.  First  suppose  x(t)  ^  x,  independent  of  t.  Then 
{X ( t ) ,  te[0,®)}e  SIL(sp)  by  Example  4.1.  Now  suppose  X  is  increasing. 
Then  A(t)  =  X(u)du  is  increasing  and  convex.  Clearly 
{X(t) ,  te[0,®) }  =t  {N( A(t ) ) ,  t  c  [0,®)}  where  {N(t),  t  >  0}  is  a 
homogeneous  Poisson  process  with  intensity  A  =  1.  But  we  have  shown  a oove 
that  (N(t),  t e[0 ,®) }  e  SIL(sp).  Thus  {X( t ) ,  t  e  [0,®)}  e  SICX(sp)  by 
Proposition  3.5(a).  The  proof  the  SICV(sp)  case  is  similar.  :i 


Example  4.3.  (sum  of  independent  random  variables).  Let  X  ■ ,  j  =  1,2,  ..., 

n 


be  independent  nonnegative  random  variables.  Set  h  0,  S  =  X , 


j  =  l 


(a)  If  {Xj ,  j  e  {1,2,...}}  e  SI  then  {Sn,  n  a  {0,1,2,...}}  c  SICX(sp). 


(b)  If  {Xj,  j  e  {1,2,...}}  e  SO  then  {S n ,  n  e  {0,1,2,...}}  e  SICV(sp). 


(c)  If  X,,  j  =  1,2,...,  are  identically  distributed  then 


{Sn,  n  e  {0,1,2,...}}  e  SIL(sp). 


Proof,  (a)  Suppose  {X.,  j  c  {1,2,...}}  e  SI.  Let  ni ,  i  =  1,2, 3, 4, 

0 


be  such 


that  n^  <  n2  <  n3  $  n4  and  n^  +  n4  =  n2  +  n3.  Let  X • ,  j  =  1,  ...,  n^ 


be 


random  variables  such  that  x 


st 


=  Xj .  Let  Yj  ,  j  =  n^+1,  ...,  n^,  be  such 


that  Y.  =  X.  and  let  Y.,  j  =  n-,  +  1,  ....  n, ,  be  such  that  Y.  X.  and 

J  J  J  3  4  J  J 


Yn  +J  >  Yn  +J  41-s.,  J  =  1,2,3,  ...,  nrn3  (=n2-n1).  [Since 
^  st  ^ 

X_  X  ..it  follows  from  Theorem  2.4  that  such  random  variables  can  be 

n3  J  ni+y 


constructed  on  a  common  probability  space.]  Furthermore,  tne  random  variables 


X.,  j  =  1,  ....  n-1  and  the  random  vectors  (Y  .  ,  Y  ),  k  =  1,  ....  n 

n-,  can  be  taken  such  that  all  are  mutually  independent  [just  generate  them 


from  independent  uniform  (0,1)  random  variables]. 


'1  „ 

X;,  5  = 


n 


1  . 

X  •  * 


Now  set  S, 


X 


=  L  xi  +  L  Yi  +  u  X;  and  s,,  =  L  X  ■  +  X- 

j  =  l  J  j  =  n  ^  + 1  J  j  =  n0  +  l  J  j  =  l  J  j=n1+l  J 

n3  .  n4 

+  i  X-  +  i  V  .  Clearly  S.  =c  S  i  =  1,2, 3, 4.  Also,  clearly, 
j=n2+l  J  j  =n  3+ 1  J  '  l 

A  A  A  *  A  a  A  A 

a.s.,  S1  +  S4  s  +  S3  and  <  [S?,S^]  «  S^.  Thus 
(S  ,  n  e  {0,1,2,...}}  e  SICX(sp). 

The  proof  of  (b)  uses  a  similar  idea  and  is  omitted.  Statement  (c)  has 
been  proven  in  Example  4.1.  An  alternative  proof  of  (c)  can  be  obtained  from 

A  A 

the  proof  of  (a)  by  taking  there  Y  . .  =  V  . ,  j  =  l,  nd-nv  i 

31"0  n  i+J  0 

Example  4.4.  (binomial  random  variables  with  parameter  p).  Let  { X ( p ) ,  pc 
[0,1]}  be  a  collection  of  binomial  random  variables  with  parameters  n  and 
p  (n  is  a  fixed  integer).  Then  { X ( p ) ,  pc  [0,1]}  e  SIL(sp). 

Proof.  First  note  that  X(p)  X,  (p)+...+x  (p)  where  X i (p) ,  j  =  1 . 

n,  are  independent  and  identically  distributed  Bernoulli  random  variables 
with  P{XJ(p)  =  1}  =  p.  :ie  fi  rst  show,  for  j  =  1,2,  ...,  n,  tnat 


(4.1) 


{ X ; ( P ) ,  P  e  [0,1]}  c  SIL(sp)  . 


To  see  it  let  P ^ ,  i  1,2, 3, 4,  be  such  that  p^  c  p£  c  p3  p^  and 

p^  +  p^  =  p2  +  P3.  Let  U  be  a  uniform  (0,1)  random  variable.  Let  I  ^ 

denote  the  indicator  function  of  A.  Oefine  X.  =  I  . , 

1  'JJ 

X0  =  I  ...  , ,  X0  =  I  r ,  1  ,  +  I  ,  ann 

?.  1  d  ^  p  ^  }  3  j  l  P  ^ » J  P  ^  ; 

X,  =  I  ,.  Then  X,  X  -  ( p -  ) ,  i  =  1,2, 3, 4,  ini 
*+  l '  J  ^  P  S  ■  J  1 

/.  ,  i  -  1,2, 3, 4,  satisfy  ( *. )  and  (i-cx)  or  iefinition  3.1. 

From  Theorem  3.10  and  (4.1)  it  follows  tnat 

n 

(.  X  ( p )  ,  p  e  L  L) ,  I  ]  }  =  1  ,  X ;  ( p )  ,  p  c  [  l .  M  ;  '  J  ‘  L  (  s  1) ) . 

J 


•  *  *  *  «  •  *  •  ~  •  ■  “  ■  V  .  *,  •_  \  .  «  .  ",  ,  ,  > 

*  *  -  .  *  m  -  *  •  a  n  -  V-  fc  V">  »  .  -  i-  m  »  ►  • 


Example  4.5.  (location-scale  parametri zations ) . 

(a)  Let  Z  be  a  nonneyative  random  variable  and  let  a  be  a  constant. 

Set  X ( 0)  =  a  +  GZ,  -3  >  0.  Then  { X  (  u ) ,  o  c  [0,*>)}  £  SIL(sp). 

(b)  Let  Z  be  a  nonneyative  random  variable.  Set  X(.j)  =  Z/o,  :j  >  0. 

Then  {X(ti),  6  e  (0,-)}  e  SDCX(sp). 

Proof.  Suppose  Z  has  the  survival  function  5.  Usiny  the  notation  of  Lemma 
3.8  we  have  F- 1  ( u ;  0)  =  a  +  uG'^u)  for  (a)  and  F_1(u;0)  =  for 

(b).  The  first  F~*(u;*)  is  increasing  and  linear  and  the  second  P-1(u;*) 
is  decreasiny  and  convex.  The  two  results  then  follow  from  Lemma  3.8. 

5.  Appl i cations  . 

5.1.  GI/G/1  queue.  Consider  a  single  server  queueing  system  at  which 
customers  arrive  according  to  a  renewal  process  with  i  nter-renewal  times 
{Ar ( 9 ) ,  n  =  1,2,...}  for  some  o  >  0.  The  service  times  of  these  customers 
form  a  sequence  of  independent  and  identically  distributed  random  variables 
{ B n ( u ) ,  n  =  0,1,2,...},  u  >  0,  independent  of  { An (  j ) ,  n  =  1,2,...:  .  Let 
Un(0,p)  be  the  waiting  time  of  trie  n-th  customer  [W^ ( 0 ,u )  :  0].  It  is  well 
known  [see,  e.y.,  Ross  (l9o’)]  that 
Wplbtu)  =  [*In_|(d,u)  +  _  A^(j)]  ,  n  =  1,2,  ...  . 

Theorem  b.l  .  (a)  Fix  y  >  U.  If  (A  (-3),  jc(U,®)}  £  SICV(sp)  for 

n  =  1,2,  ...,  then  (W  (u,y),  a  Si)CX(sp)  for  n  =  1,2,  ...  . 

(b)  Fix  3  >  0.  If  {B  n  (  p )  ,  ue(  0  ,«>) }  SDCX(sp)  for  n  =  0,1,2,  ...,  then 
(Wn(j,u),  ue(0,°°)}  c  SDCX(sp)  for  n  =  1,2,  ...  . 

Proof .  We  prove  (a);  the  proof  of  (b)  is  similar.  Certainly 
{W0(  y,u) ,  0c( 0 ,°°) }  e  SDCX(sp) .  Suppose  [Un_  j  (  0,u) ,  0  *  (0,-)}  c 
Si)CX(sp).  Note  that  if  (An(3),  3  c  (0,»)}  c  SICV(sp)  then  {-An(j),  ;• 
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£  ( 0 .  <*») }  t:  SL)CX(sp).  Thus  Theorem  3.10  implies  that 
(5.1)  {W^e.p)  +  Bn_1  (u)  -  An(0),  a  e  (0,-)}  £  SDCX(sp). 

The  function  [x]+  is  increasing  and  convex.  Thus  from  (5.1)  and  Proposition 

3.2(b)  it  follows  that  (W  (’3,u),  >3  e  (0,°°)}  = 

{[Wn_1(G,u)  +  Bn_1(u)  -  An(0)]+,  3  e  (0,®)}  £  SDCX(sp) .  :i 

Remark  5.2.  Let  { Xn ,  n  =  0,1,...}  be  a  sequence  of  independent  and 
identically  distributed  nonnegative  random  variables  and  set  3  (y)  =  X  / 1 1 . 
Then  {3  (y),  ue(0,®)}  e  SOCX(sp)  [Example  4.5(b)],  Therefore  the  waiting 

time  {W n ( 3 , u ) ,  ue(0,®)}  in  this  GI/G/1  queue  is  SDCX(sp)  and  hence  SJCX 
[Theorem  3 .6 J .  The  convexity  of  E[Wn(9,p)]  with  respect  to  u  is  proven  in 
Weber  (1983).  From  Proposition  2.11  it  follows  that  the  steady  state  mean 
waiting  time  in  this  queue  is  convex  with  respect  to  y.  This  fact  has  oeen 
established  in  Tu  and  Kumin  (1983).  Observe  that  in  Theorem  5.1(b)  we  no  not 
restrict  8  (u)  to  take  this  specific  form. 

5.2.  GI/G/c  queue  with  rotary  assignment.  Consider  a  single  stage  queueing 
system  with  c  parallel  serves  at  which  customers  arrive  according  to  a 
renewal  process  with  i nter-arri val  times  (Rn,  n  =  1,2,...}.  The  service  times 
of  these  customers  form  a  sequence  {Bn,  n  =  1,2,...}  of  independent  and 
identically  distributed  random  variables  independent  of  ,  n  =  1,2,...). 

The  customers  are  assigned  to  the  servers  in  a  rotary  manner.  That  is,  the 
(cn+r)-th  customer  is  assigned  to  server  r  (r=l, 2, ...,c;n=o,l ,...).  The 
stationary  waiting  time  (say  W(c))  of  an  arbitrary  customer,  when  it  exists 
[that  is,  when  c  is  large  enough,  say  c  a  c*  for  some  c*]  has  the  same 


distribution  as  that  of  the  stationary  waiting  time  of  an  arbitary  customer  in 
a  GI/G/1  queue  with  i nter-arri vai  times  {An(c)  =  R(n-1 )c+l+*  •  *+Rnc’  n  = 
1,2,...}  and  service  times  {Bn,  n  =  1,2,...}.  In  Example  4.3(c)  it  is  shown 
that  (An(c),  ce{ 1 ,2 , . . . } }  is  SICV(sp)  [in  fact  SIL(sp) ].  Thus,  from  Theorem 
5.1(a),  Theorem  3.6  and  Proposition  2.11,  one  has 

Corollary  5.3.  The  stationary  waiting  time  U(c)  of  an  arbitrary  customer  in 
a  GI/G/c  queue  with  rotary  assignment  satisfies  {W(c ) ,  c  e  (c*,»)}  c 
SDCX(sp) . 

Remark  5.4.  Rolfe  (1971)  conjectured  that  E[W( c ) ]  is  convex  in  c  >  c*  for 
a  GI/G/c  queue  with  first  come  first  served  service  policy  and  proved  it  for 
the  M/D/c  queue.  For  the  GI/O/c  queue  the  distribution  function  of  the 
stationary  waiting  time  is  the  same  under  the  rotary  assignment  and  first  come 
first  served  service  policy.  Thus  Corollary  5.3  extends  the  result  of  Rolfe 
(1971)  to  tn<j  GI/D/c  queue  and  provides  a  partial  answer  to  his  conjecture. 

5.3.  FP/r'1(n)/l  queue.  Consider  a  single  stage  queueing  system  at  which 
customers  arrive  according  to  a  Poisson  process  with  rate  A  >  9.  Customer 

n  brings  a  random  number  Bn  of  tasks,  n  =  1,2 .  The  3n  1  s  are 

independent  and  identically  distributed.  Denote  =  p(3n  ->  b  ? ,  o  = 

0,1,2,...  .  The  service  requirements  of  these  tasks  form  a  sequence  of 
independent  .  identically  distributed  mean  exponential  random  enables 
independent  of  {Bn,  n  =  1,2,...’  The  service  rate  is  ,  ( n )  when  there  are 
n  tasks  in  the  system,  n  =  0,1,2,...  ,  where  y(0)  =  0  and  .(n)  >  1  for  n 
«  1.  Let  M*)  denote  the  number  of  tasks  in  the  system  at  time  t. 


Theorem  5.5.  Suppose  y(n)  is  increasing  and  concave  in  n  =  0,1,?,...  . 
(a)  If  lim  y(  n)  <  «>  and  if  {Y  fJ(  ,\)  ,.\c(0,^)  }cSICX(sp)  then 


(5.2; 


(Y  (A),  A  (0,»)}  c  SICX(sp)  for  all  t  >  0. 


)b)  If  for  some  A*  >  0  the  steady  state  distribution  exists  for 

A  c  ( 0 ,  ,\*  ]  and  Y  t  (  X ) 5  Y*(a)  as  t  ->  «>  for  each  A  c  (0,A*]  then 


■ 

1 Y* (  A)  , 

A e ( 0 , A* ] }  c  SICX. 

1 

Proof.  Suppose 

y„  z  1  i:n  y(n)  <  ® 
n^°° 

Let 

A$  be 

an  arbitrary  (large) 

">■ 

number  and  set 

n  =  2(A_+uyc)  <  “• 

^  s 

For 

A  -S  A 

s 

consider  the  Marxov 

cl 

(Xn( a),  n  =  0,1 , 

?,...}  with  state 

space 

’(0,1  ,2, 

...}  and  transition 

6: 

probabilities  determined  by 

A'-  ’ 


■ -i  o 


if  y  =  x 


if  y  >  x. 


Suppose 


(5.3) 


Xq ( A )  Yq(a) 


Let  (N(t),  t  >  0}  be  a  Poisson  process  with  rate 


denned  on  tie  same 


probability  space  as  that  of  {X  (,\),  n  =  0,1,2,...;-  and  independent  of  if, 
From  (5.3)  it  follows  that  tne  uniformized  process  t  ;>  o’ 


a  t  i  s  f  i  e  s 


(5.4) 


(YtU),  t  >  0}  CXN(t)(X).  t  >  0} 

[see,  e.g.,  Keilson  (  1  979)].  Since  1  -  — ^ ^  ^  s  —  it  follows  that  for 

n  n 

each  y, 

(5.5)  F  (y;A)  increases  in  x  e  {0,1,2,...}  and  in  A  e  (0,A  1. 

*>  s 

We  will  show  tnat,  for  every  n  e  {0,1,2,...}, 

(5.6)  {Xn(A),  A  c  (0,A  ]}  £  SICX(sp)  . 

From  Theorem  3.9  and  (5.4)  it  then  follows  that 
(Yt(A),  A  c  ( 0 , A^ ] }  e  SICX(sp)  and  since  As  is  arbitrary  we  obtain  (5.2). 
The  proof  of  (5.6)  is  by  induction  on  n.  By  assumption,  (5.6)  is  true 
when  n  =  0.  Suppose  (5.6)  is  true  with  n  -  1  replacing  n.  Let 
Xi  e  (0,AS],  i  =  1,2, 3, 4,  be  such  that  $  A?  s  a3  «  A^  and  =  a ? 

+  A3.  Then  by  the  induction  hypothesis  there  exist  X^ ,  i  =  1,2, 3, 4,  defined 
on  a  common  probability  space  such  that  Xi  =l  XR  (Ai),  i  =  1,2, 3, 4,  and 
such  that  (cx)  and  (i-cx)  of  Definition  3.1  hold.  Let  xi#  i  =  1,2, 3, 4,  be  a 
particular  realization  of  X.  ,  i  =  1,2, 3, 4.  Thus  [x^x^.x-j]  <  x4  and 

(5.7)  x^  +  x4  >  . 

First  suppose  that  equality  holds  in  (5.7),  that  is,  x^  +  x^  =  <0  + 
x^.  Construct  X^  ,  i  =  1,2, 3, 4,  on  a  common  probability  space  using  two 
independent  uniform  (0,1)  random  variables  and  as  follows: 

(i)  If  Uj  £  (0,A./n)  then  X.  ;  x].  +  Q- 1  (U 2 ) ,  i  =  1,2,4,  and  if 


e  (U,A^/n)  \J  (A^/n,X^/n)  tnen  X^  c  +  Q-1(lJ2). 

(ii)  If  e  ( /n,l-( U7S / n) )  then  X.  ox.  ,  i  =  1,2,4,  and  if 

U1  e  (A1/n,A2/n)  0  (A4/n,l-(uYs/n)  j  then  <3  a  . 

(iii)  If  e  [l-( nY^/n) ,1 j  then  x.  =  x.  -  a- ,  i  =  1,2, 3, 4,  where 

Ai  5  I[U2<Y(xi  )/y$]’  1  =  1,2,4  and 

A3  I[U2<y(x1)/ys]  +  [[  y(x2)  /ys<U2<  (y(x?  )  +y(  x3 )  -y(  X  , ) /ys] 

It  is  now  verified  that  X-  CXn( Ai ) |Xn-1( Ai )  =  x.],  i  =  1,2, 3, 4.  The 
verification  of  [X1,X9,X3]  <  X4  and  x  +  X4  >  X0  +  :<3  a.s.  in  cases  M  ' 
and  (ii)  is  simple.  In  (iii)  notice  that,  by  assumption,  x^  +  x,  =  <0  r  < , 
and  that  the  concavity  of  y(*)  implies  y(x?)  +  y(x3)  -  y(x^  ;  (xj,.  Thu? 
A^  +  <  a2  +  a3  hence  X ^  +  X^  s  X?  +  X3  a.s.  To  prove 

(5.3)  ^Xj,X2,X3j  <*  a.s., 

note  that  (5.3)  can  be  violated  only  if  x4  =  xi  for  some  i  e  {1,2,31.  But 
since  we  postulate  x^  +  x4  =  X£  +  x3  it  follows  that  if  x4  =  x^  for  some 
i  c  {1,2,3}  then  a^  =  A^  for  that  i  and  thus  (5.3)  holds. 

Summarizing  the  results  of  the  preceediny  paragraph  we  see  that  if 
equality  holds  in  (5.7)  then  [Xr(a. )|Xn  ^ ( Ai )  =  xi ] ,  i  =  1,2, 3, 4,  "can  be 
put"  on  the  same  probability  space  such  that  (cx)  and  (i-cxi  of  "Definition  3.1 
hoi  d. 

If  strict  inequality  holds  in  (5.7)  then  using  the  stochastic 
monotonicity  (5.5)  it  can  be  shown,  by  an  argument  similar  to  the  proof  of 
Lemma  3.3,  that  [Xn(A^)|Xn  ^(A.)  =  x.],  i  =  1,2, 3, 4,  "can  tie  put"  on  the 
same  probability  space  such  that  the  analogs  of  (st),  (cx)  ami  (i-cx)  hold. 

The  proof  of  (5.6)  is  now  completed  using  the  fact  that  SICX(sp)  is  closed 
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under  mixing  [Theorem  3.9]. 

If  y$  <  00  then  statement  (b)  follows  from  (a).  Theorem  3.6  and 
Proposition  2.11.  By  standard  limiting  arguments  it  can  be  shown  tnat  (b)  is 
true  also  when  =  <«=.  n 

Remark  5.6.  For  the  M/M/c  queue  [that  is,  M/M(n)/1  with 
y(n)  =  min(n,c),  n  >  0]  Grassman  (1983)  and  Lee  and  Cohen  (1983)  showed 
that  EY*(A)  is  increasing  and  convex  in  \  e  (0,A*].  The  algebraic  proof 
used  there  can  become  very  cumbersome,  if  not  impossible,  if  one  tries  to 
establish  the  convexity  of  E<p  [  Y*  (  A ) )  in  A  for  all  increasing  convex 
functions  g>:  {0,1 ,2,..}  ->•  R.  Thus  one  sees  that  the  sample  path  approacn  is 
simple  and  very  powerful. 

5.4.  Proportion 1  hazards  and  imperfect  repair.  The  main  result  of  this 
subsection  is 

Proposition  6.7.  Let  F  be  an  absolutely  continuous  survival  function  such 

-  -P 

that  F(0)  =  1.  For  p  e  (0,1]  let  X ( p )  have  the  survival  function  F 

(that  is  the  X(p)'s  have  proportional  hazards).  Then  E  g>(  X  ( p ) )  is  convex  and 
decreasing  in  p  e  (0,1]  whenever  $  is  increasing.  In  particular 
(X(P),  p  e  (0,1]}  e  SDCX. 

In  order  to  motivate  the  proposition,  and  indicate  its  uses,  consider  the 
following  imperfect  repair  model  of  Cleroux,  Dubuc  and  Tilquin  (1979)  and 
Brown  and  Proschan  (1983). 

Model  5.8.  A  new  item  with  an  absolutely  continuous  survival  function  F 
undergoes  an  imperfect  repair  upon  each  time  it  fails  before  it  is  scrapped. 


,  V  V  V  * 

■r,  *  m  •  *  I  "  *  m 


With  probability  p  the  repair  is  unsuccessful  and  the  item  is  scrapped. 

With  probability  1  -  p  the  repair  is  successful  and  minimal,  that  is,  after 
a  successful  repair  at  time  t  the  item  is  as  good  as  a  working  item  at  age 

t . 

If  X ( p )  denote  the  time  to  scrap  in  Model  5.8  then  the  survival 
function  of  X(p)  is  F^1  (Berg  and  Cleroux  (1982)  and  Brown  and  Proschan 
( 1983) )  . 

Proof  of  Proposition  5.7.  Clearly  r^(t)  is  convex  and  decreasing  in  p  for 
eacn  te[0,<*>).  Thus  Ep(X(p))  is  convex  and  decreasing  in  p  e(0,l]  whenever 
is  a  binary  increasing  function,  and  hence  also  whenever  <j>  is  an 
increasing  step  function.  Standard  limiting  arguments  complete  the  proof. 

Proposition  5.7  can  be  applied  as  follows.  Suppose  the  cost  of 
performing  an  imperfect  repair  with  probability  1  -  p  of  unsuccessful  outcome 
is  C(p).  It  is  reasonable  to  expect  that  C(p)  decreases  in  p.  If  the 
benefit  associated  with  a  lifetime  X(p)  is  an  increasing  function 
then  the  total  benefit  B(p)  is 

3(p)  =  Ey(X(p)  )  -  C ( p ) . 

Suppose  that,  due  to  engineering  constraints,  p  must  lie  in  the  interval  [a,b] 
for  some  0  <  a  <  b  <  1,  and  that  C(p)  is  linear  in  pc.La, d1.  Then,  by 
Proposition  5.7,  B(p)  is  convex  in  [a,b].  So  p  =  a  or  p  =  o  ; s  an  optimal 
solution  which  maximizes  the  benefit. 

5.5.  Branching  processes.  Consider  a  Hal ton-Watson  discrete  time  branching 
process  { X ^  (  3 ) ,  i=(J,l ,...}  depending  on  a  parameter  v  >  0  which  is  the 


parameter  of  the  offspring  discrete  probability  function  f ( * ; e ) .  Then  the 
transition  probabi 1 ities  of  this  Markov  chain  are 


P{Xn(o)  =  y|xn_1(9)  =  x}  =  f(x)(y;Q),  x,ye{0,l ,2,...}, 


where  f(x)(«;6)  denotes  the  x-th  convolution  of  f(*;9). 


Result  5.9.  Suppose  f(*;9),  0  >  0  has  the  semigroup  property,  that  is, 

f ( • ; )*f ( • ; 9^)  =  f(»;0^+©2)  where  denotes  convolution.  If  initially 

X(j(u)  s  x,  where  x  is  a  constant  independent  of  0,  then 

{Xn( o) , 6e(0,«) } eS I CX ( s p )  for  each  n  =  1,2 . 

Proof .  We  will  show  that  for  each  n  =  0,1,2,  ...,  and  for  each  6^ ,  i  = 

1,2, 3, 4,  such  that  6,  =;  9.  <  <  o.  and  0.  +  o  =  0O  +  0_ ,  there  exist 

1  £  o  4  i  4  £  j 

A 

four  random  variables  X^  ,  i  =  1,2, 3, 4,  defined  on  the  same  probability  space 
such  that 


(5.9.1 ) 
(5.9.i i ) 
(5.9.iii) 


Xi  =  W’  1  =  ]’2’3’4’ 


\  +  x4  >  x2  +  X3, 

X1  <  ^X2’X3^  *  X4» 


a.s . , 


It  follows  then  that  { X ( 9 ) ,  o  e  (0,®)}  c  SICX(sp). 

The  proof  of  (5.9)  is  by  induction  on  n.  Clearly  (5.9)  holds  for  n  = 
0.  Suppose  (5.9)  holds  with  n  -  1  replacing  n.  Then  there  exist 
Y.j  ,  i  =  1,2, 3, 4,  defined  on  some  common  probability  space  j  such  that 

Y.  =5t  Xn-l(oi)’  1  =  1»2’3’4’  and’  d*s*’  xi  <  [Y2,Y3]  <  Y4  and 

Y1  +  Y4  '  X2  +  V 

Define  now  the  following  mutually  independent  random  varibles  which  are 


i  =  1,2, 3, 4  (we  can  take  ,2  to  be  rich 


assumed  to  be  independent  of  Y- , 
enough  to  support  these): 

Z-  having  probability  function  f(*,Q,),  j  =  1,2 

Z.  having  probability  function  f(*,3?-u,  ),  j 

•i4-32  ~  1 

Zj  having  probability  function  f( -,0^  —  o^),  j 

and  set 


1,2, 

1,2, 


1  6, 


j  =  l 


Vo 


Xo 


J 


Y.  Y^+Y.-Y.  „ 

1  0,  e.-u.  2  3  10.  },  -0,, 

1  [Z-1  ♦  Z.4  Z:  +  jZ.1  *  Z  4  2i 

j-i  1 J  J  ‘  j:v2*i  1  J  J  1 


j  =  l 


j,  °9_,1  'J/\~'}2  , 

Y  *  Y  +  Y  !• 


Then,  from  the  semigroup  property  it  follows  that  X..  =  X  (0.  ),  i  = 

1,2, 3, 4.  Clearly  X.  <  "X0 , X-,  1  <  X.  a.s.,  and  since  ?,  >  L  +  L  -  y.  , 
also  Kj  *  x4  >  X2  a-  X3,  a.s.  > 

Similar  results  hold  also  for  continuous  time  branching  processes.  These 
will  be  discussed  elsewhere. 


5.6.  Empirical  distribution  functions.  Let  Yp  Y->,  ...,  Yn  :>e  independent 
random  variables  with  a  common  distribution  function  F.  Suppose  the  support 
0  of  F  is  an  interval  of  real  numbers  or  integers.  Denote  by 
Fn(t),  t  o  u,  the  empirical  distribution  function  constructed  from  tne  Y^'s. 


Result  5.10.  If  F  is  convex  [concave,  linear]  on 


0  then  (Fn(t),  t  e  0}  e  SICX(sp)  [SICV(sp),  SIL(sp)]. 

To  prove  Result  5.10  note  that  Fn(t)  has  a  binomial  distribution  with 
parameters  n  and  F(t).  Thus  the  result  follows  from  Example  4.4  and 
Proposition  3.5. 

5.7.  Convex  parametri zat i on .  According  to  Schweder  (1982),  a  family 

(P Q, OeO}  [0  is  an  interval  of  real  numbers  or  of  integers]  of  distributions 

O 

is  called  convexly  parametrized  if  E$(X(6))  is  convex  for  every  convex 
function  y  where  X(d)  is  distributed  according  to  Pg.  That  is,  { X ( 0 ) ,  G 
e  0}  e  SCX  [see  Definition  2.6(b)],  By  Proposition  3.7,  (X(o),  6  c  C)  e 

SCX  whenever  (X(0),  0  e  0}  e  SIL(sp)  or  SDL(sp).  Thus  Examples  4.1,  4.4 
and  4.5  yield  a  host  of  convexly  parametrized  families  of  distributions  (some 
of  which  have  already  been  noticed  by  Schweder  (1982)).  For  these  families  of 
distributions,  Schweder  (1982)  and  Shaked  (1980)  obtained  various  inequalities 
useful  in  biology  and  statistics. 

5.8.  Majorization  and  Schur-convexi ty .  Let  X(e^),  j  =  1,2,  ...,n,  be 

independent  random  variables  having  distributions  F(«;9.)»  J  =  1.2,  ...»  n, 

respectively,  where  (F(»;9),  0  e  0}  is  a  family  of  distributions.  Marshall 

and  Olkin  (1979,  p.  102)  snowed  that  if  (F(*;0),  OeO}  satisfies  the 

semigroup  property  [see,  e.g..  Example  4.1]  and  if  F(x;0)  has  some  total 

positivity  property  then  E;(X(u1),  ...,  X(on))  is  Schur-convex  in 

(o^,...,on)  whenever  y(x.  ,...,x  )  is  Schur-convex.  In  particular,  if 

1  n  n 

y: R+R  is  convex  then,  under  the  conditions  above,  E  v(X(->.))  is  Schur- 

j  =  l  J 

convex  in  (u^,...,un). 


From  Example  4.1  and  Proposition  3.7  we  see  that  for  each  j  =  1,  ..., 


n,  E$(X(9.))  is  convex  in  $■  whenever  0  e  c}  has  the  semigroup 

J  J  n 

property.  Thus,  if  $  is  convex,  then  E  \  p(X(3.))  is  symmetric  and  convex 

j  =  l  J 

in  (0^,...,3n)  and  hence  Schur-convex  in  ( 0^, . . . ,un ) . 

The  latter  conclusion  (which  is  weaker  than  the  conclusion  of  Marshall 
and  Olkin  (  1979, p. 102) )  is  ootained  without  the  total  positivity  assumption  of 
Marshall  and  Olkin  (1979,  p.  102). 

5.9.  Cumulative  damage  shock  models.  Esary,  Marshall  and  Proschan  (1973) 
considered  the  fol owing  model  for  wear  processes. 

Model  5.11.  An  item  is  subjected  to  shocks  occurring  randomly  in  time 
according  to  a  Poisson  process  {N(t),t>0}  with  rate  \.  The  i-th  shock 
causes  a  nonnegative  random  damaye  X.-.  The  damages  are  independent  and 
accumulate  additively. 

Denote  a  0,  Sn  =  Sn_j  +  Xn,  n  =  1,2,...  .  Thus  at  time  t  >  0  the 

accumulated  damaye  is 

Result  5.12.  (a)  If  -X . ,  i e{l ,2, .. .} }  e  SI  then 

tcCO  ,*») }  e  SICX(sp) . 

(b)  If  {Xit  i  c  {1,2,...}}  t  SD  then  {S^t),  te[0,») }  cSlC\l{  sp ) . 

(c)  If  the  X^'s  are  identically  distributed  then 

.  tc[0,»)  }cSIL(sp) . 

The  proof  of  this  result  consists  of  two  steps.  For  tj  ,  i  =  1,2, 3, 4, 
such  that  t^  s  t-,  <  t3  4  t^  and  tj  +  t4  =  t-,  +  t^,  first  construct 
il.  ,  i  =  1,2, 3, 4,  such  tnat  rU^),  i  =  1,2, 3, 4,  and  a.s. 

A  A  A  A  A  A  A  A 

s.  Nj  and  ;i^  +  il^  =  N  +  N^,  as  in  Example  4.1.  Then 

*  A  st 

construct  S.  ,  i  =  1,2, 3, 4,  sucn  that  S.  =  S„  ,  i  =  l, 2, 3, 4,  and,  a.s.. 
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+■  [ < »= and  S1  *»  C S ^ » S ^ ^ 

Other  convexity  results  can  be  obtained  for  Model  5.11.  For  example, 
under  the  assumptions  of  Result  5.12(a)  [(b),  (c)]  the  wear  process  at 

time  t  is  SICX(sp)  [SICV(sp),  SIL(sp) ]  in  x  e  (0,-).  If  the  distribution 
of  the  X .j 1  s  of  Model  5.11  depends  on  0  then  for  each  t  >  0,  stochastic 
convexity  [concavity,  linearity]  of  in  0  follows  from  stochastic 

convexity  [concavity,  linearity]  of  each  X^  in  0  provided  the  X^'s  are 
identically  distributed.  We  omit  the  proofs  of  these  results. 
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